Overview of the CLEF 2007 Multilingual Question Answering Track
Identifieur interne : 000048 ( France/Analysis ); précédent : 000047; suivant : 000049Overview of the CLEF 2007 Multilingual Question Answering Track
Auteurs : Danilo Giampiccolo [Italie] ; Pamela Forner [Italie] ; Jesús Herrera [Espagne] ; Anselmo Pe As [Espagne] ; Christelle Ayache [France] ; Corina Forascu [Roumanie] ; Valentin Jijkoun [Pays-Bas] ; Petya Osenova [Bulgarie] ; Paulo Rocha [Portugal] ; Bogdan Sacaleanu [Allemagne] ; Richard Sutcliffe [Irlande (pays)]Source :
- Lecture Notes in Computer Science [ 0302-9743 ] ; 2008.
Abstract
Abstract: The fifth QA campaign at CLEF [1], having its first edition in 2003, offered not only a main task but an Answer Validation Exercise (AVE) [2], which continued last year’s pilot, and a new pilot: the Question Answering on Speech Transcripts (QAST) [3, 15]. The main task was characterized by the focus on cross-linguality, while covering as many European languages as possible. As novelty, some QA pairs were grouped in clusters. Every cluster was characterized by a topic (not given to participants). The questions from a cluster possibly contain co-references between one of them and the others. Finally, the need for searching answers in web formats was satisfied by introducing Wikipedia as document corpus. The results and the analyses reported by the participants suggest that the introduction of Wikipedia and the topic related questions led to a drop in systems’ performance.
Url:
DOI: 10.1007/978-3-540-85760-0_27
Affiliations:
- Allemagne, Bulgarie, Espagne, France, Irlande (pays), Italie, Pays-Bas, Portugal, Roumanie
- Communauté de Madrid
- Madrid, Paris
- Université complutense de Madrid
Links toward previous steps (curation, corpus...)
- to stream Istex, to step Corpus: 002651
- to stream Istex, to step Curation: 002209
- to stream Istex, to step Checkpoint: 000B91
- to stream Main, to step Merge: 001175
- to stream Main, to step Curation: 001162
- to stream Main, to step Exploration: 001162
- to stream France, to step Extraction: 000048
Links to Exploration step
ISTEX:A6C1D4810E440082906320C08345260FB5F100E1Le document en format XML
<record><TEI wicri:istexFullTextTei="biblStruct"><teiHeader><fileDesc><titleStmt><title xml:lang="en">Overview of the CLEF 2007 Multilingual Question Answering Track</title><author><name sortKey="Giampiccolo, Danilo" sort="Giampiccolo, Danilo" uniqKey="Giampiccolo D" first="Danilo" last="Giampiccolo">Danilo Giampiccolo</name></author><author><name sortKey="Forner, Pamela" sort="Forner, Pamela" uniqKey="Forner P" first="Pamela" last="Forner">Pamela Forner</name></author><author><name sortKey="Herrera, Jesus" sort="Herrera, Jesus" uniqKey="Herrera J" first="Jesús" last="Herrera">Jesús Herrera</name></author><author><name sortKey="Pe As, Anselmo" sort="Pe As, Anselmo" uniqKey="Pe As A" first="Anselmo" last="Pe As">Anselmo Pe As</name></author><author><name sortKey="Ayache, Christelle" sort="Ayache, Christelle" uniqKey="Ayache C" first="Christelle" last="Ayache">Christelle Ayache</name></author><author><name sortKey="Forascu, Corina" sort="Forascu, Corina" uniqKey="Forascu C" first="Corina" last="Forascu">Corina Forascu</name></author><author><name sortKey="Jijkoun, Valentin" sort="Jijkoun, Valentin" uniqKey="Jijkoun V" first="Valentin" last="Jijkoun">Valentin Jijkoun</name></author><author><name sortKey="Osenova, Petya" sort="Osenova, Petya" uniqKey="Osenova P" first="Petya" last="Osenova">Petya Osenova</name></author><author><name sortKey="Rocha, Paulo" sort="Rocha, Paulo" uniqKey="Rocha P" first="Paulo" last="Rocha">Paulo Rocha</name></author><author><name sortKey="Sacaleanu, Bogdan" sort="Sacaleanu, Bogdan" uniqKey="Sacaleanu B" first="Bogdan" last="Sacaleanu">Bogdan Sacaleanu</name></author><author><name sortKey="Sutcliffe, Richard" sort="Sutcliffe, Richard" uniqKey="Sutcliffe R" first="Richard" last="Sutcliffe">Richard Sutcliffe</name></author></titleStmt><publicationStmt><idno type="wicri:source">ISTEX</idno><idno type="RBID">ISTEX:A6C1D4810E440082906320C08345260FB5F100E1</idno><date when="2008" year="2008">2008</date><idno type="doi">10.1007/978-3-540-85760-0_27</idno><idno type="url">https://api.istex.fr/document/A6C1D4810E440082906320C08345260FB5F100E1/fulltext/pdf</idno><idno type="wicri:Area/Istex/Corpus">002651</idno><idno type="wicri:Area/Istex/Curation">002209</idno><idno type="wicri:Area/Istex/Checkpoint">000B91</idno><idno type="wicri:doubleKey">0302-9743:2008:Giampiccolo D:overview:of:the</idno><idno type="wicri:Area/Main/Merge">001175</idno><idno type="wicri:Area/Main/Curation">001162</idno><idno type="wicri:Area/Main/Exploration">001162</idno><idno type="wicri:Area/France/Extraction">000048</idno></publicationStmt><sourceDesc><biblStruct><analytic><title level="a" type="main" xml:lang="en">Overview of the CLEF 2007 Multilingual Question Answering Track</title><author><name sortKey="Giampiccolo, Danilo" sort="Giampiccolo, Danilo" uniqKey="Giampiccolo D" first="Danilo" last="Giampiccolo">Danilo Giampiccolo</name><affiliation wicri:level="1"><country xml:lang="fr">Italie</country><wicri:regionArea>CELCT, Trento</wicri:regionArea><wicri:noRegion>Trento</wicri:noRegion></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Italie</country></affiliation></author><author><name sortKey="Forner, Pamela" sort="Forner, Pamela" uniqKey="Forner P" first="Pamela" last="Forner">Pamela Forner</name><affiliation wicri:level="1"><country xml:lang="fr">Italie</country><wicri:regionArea>CELCT, Trento</wicri:regionArea><wicri:noRegion>Trento</wicri:noRegion></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Italie</country></affiliation></author><author><name sortKey="Herrera, Jesus" sort="Herrera, Jesus" uniqKey="Herrera J" first="Jesús" last="Herrera">Jesús Herrera</name><affiliation wicri:level="4"><country xml:lang="fr">Espagne</country><wicri:regionArea>Departamento de Ingeniería del Software e Inteligencia Artificial, Universidad Complutense de Madrid</wicri:regionArea><placeName><settlement type="city">Madrid</settlement><region nuts="2" type="region">Communauté de Madrid</region></placeName><orgName type="university">Université complutense de Madrid</orgName></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Espagne</country></affiliation></author><author><name sortKey="Pe As, Anselmo" sort="Pe As, Anselmo" uniqKey="Pe As A" first="Anselmo" last="Pe As">Anselmo Pe As</name><affiliation wicri:level="1"><country xml:lang="fr">Espagne</country><wicri:regionArea>Departamento de Lenguajes y Sistemas Informáticos, UNED, Madrid</wicri:regionArea><wicri:noRegion>Madrid</wicri:noRegion></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Espagne</country></affiliation></author><author><name sortKey="Ayache, Christelle" sort="Ayache, Christelle" uniqKey="Ayache C" first="Christelle" last="Ayache">Christelle Ayache</name><affiliation wicri:level="1"><country xml:lang="fr">France</country><wicri:regionArea>ELDA/ELRA, Paris</wicri:regionArea><placeName><settlement type="city">Paris</settlement></placeName></affiliation><affiliation wicri:level="1"><country wicri:rule="url">France</country></affiliation></author><author><name sortKey="Forascu, Corina" sort="Forascu, Corina" uniqKey="Forascu C" first="Corina" last="Forascu">Corina Forascu</name><affiliation wicri:level="1"><country xml:lang="fr">Roumanie</country><wicri:regionArea>Faculty of Computer Science, University “Al. I. Cuza” of Iaşi, Romania Institute for Computer Science, Romanian Academy, Iaşi</wicri:regionArea><wicri:noRegion>Iaşi</wicri:noRegion></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Roumanie</country></affiliation></author><author><name sortKey="Jijkoun, Valentin" sort="Jijkoun, Valentin" uniqKey="Jijkoun V" first="Valentin" last="Jijkoun">Valentin Jijkoun</name><affiliation wicri:level="1"><country xml:lang="fr">Pays-Bas</country><wicri:regionArea>Informatics Institute, University of Amsterdam</wicri:regionArea><wicri:noRegion>University of Amsterdam</wicri:noRegion></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Pays-Bas</country></affiliation></author><author><name sortKey="Osenova, Petya" sort="Osenova, Petya" uniqKey="Osenova P" first="Petya" last="Osenova">Petya Osenova</name><affiliation wicri:level="1"><country xml:lang="fr">Bulgarie</country><wicri:regionArea>BTB</wicri:regionArea></affiliation><affiliation><wicri:noCountry code="no comma">E-mail: petya@bultreebank.org</wicri:noCountry></affiliation></author><author><name sortKey="Rocha, Paulo" sort="Rocha, Paulo" uniqKey="Rocha P" first="Paulo" last="Rocha">Paulo Rocha</name><affiliation><wicri:noCountry code="subField">Norway and Portugal</wicri:noCountry></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Portugal</country></affiliation></author><author><name sortKey="Sacaleanu, Bogdan" sort="Sacaleanu, Bogdan" uniqKey="Sacaleanu B" first="Bogdan" last="Sacaleanu">Bogdan Sacaleanu</name><affiliation wicri:level="1"><country xml:lang="fr">Allemagne</country><wicri:regionArea>DFKI</wicri:regionArea></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Allemagne</country></affiliation></author><author><name sortKey="Sutcliffe, Richard" sort="Sutcliffe, Richard" uniqKey="Sutcliffe R" first="Richard" last="Sutcliffe">Richard Sutcliffe</name><affiliation wicri:level="1"><country xml:lang="fr">Irlande (pays)</country><wicri:regionArea>DLTG, University of Limerick</wicri:regionArea><wicri:noRegion>University of Limerick</wicri:noRegion></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Irlande (pays)</country></affiliation></author></analytic><monogr></monogr><series><title level="s">Lecture Notes in Computer Science</title><imprint><date>2008</date></imprint><idno type="ISSN">0302-9743</idno><idno type="eISSN">1611-3349</idno></series><idno type="istex">A6C1D4810E440082906320C08345260FB5F100E1</idno><idno type="DOI">10.1007/978-3-540-85760-0_27</idno><idno type="ChapterID">Chap27</idno><idno type="ChapterID">27</idno></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass><langUsage><language ident="en">en</language></langUsage></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">Abstract: The fifth QA campaign at CLEF [1], having its first edition in 2003, offered not only a main task but an Answer Validation Exercise (AVE) [2], which continued last year’s pilot, and a new pilot: the Question Answering on Speech Transcripts (QAST) [3, 15]. The main task was characterized by the focus on cross-linguality, while covering as many European languages as possible. As novelty, some QA pairs were grouped in clusters. Every cluster was characterized by a topic (not given to participants). The questions from a cluster possibly contain co-references between one of them and the others. Finally, the need for searching answers in web formats was satisfied by introducing Wikipedia as document corpus. The results and the analyses reported by the participants suggest that the introduction of Wikipedia and the topic related questions led to a drop in systems’ performance.</div></front></TEI><affiliations><list><country><li>Allemagne</li><li>Bulgarie</li><li>Espagne</li><li>France</li><li>Irlande (pays)</li><li>Italie</li><li>Pays-Bas</li><li>Portugal</li><li>Roumanie</li></country><region><li>Communauté de Madrid</li></region><settlement><li>Madrid</li><li>Paris</li></settlement><orgName><li>Université complutense de Madrid</li></orgName></list><tree><country name="Italie"><noRegion><name sortKey="Giampiccolo, Danilo" sort="Giampiccolo, Danilo" uniqKey="Giampiccolo D" first="Danilo" last="Giampiccolo">Danilo Giampiccolo</name></noRegion><name sortKey="Forner, Pamela" sort="Forner, Pamela" uniqKey="Forner P" first="Pamela" last="Forner">Pamela Forner</name><name sortKey="Forner, Pamela" sort="Forner, Pamela" uniqKey="Forner P" first="Pamela" last="Forner">Pamela Forner</name><name sortKey="Giampiccolo, Danilo" sort="Giampiccolo, Danilo" uniqKey="Giampiccolo D" first="Danilo" last="Giampiccolo">Danilo Giampiccolo</name></country><country name="Espagne"><region name="Communauté de Madrid"><name sortKey="Herrera, Jesus" sort="Herrera, Jesus" uniqKey="Herrera J" first="Jesús" last="Herrera">Jesús Herrera</name></region><name sortKey="Herrera, Jesus" sort="Herrera, Jesus" uniqKey="Herrera J" first="Jesús" last="Herrera">Jesús Herrera</name><name sortKey="Pe As, Anselmo" sort="Pe As, Anselmo" uniqKey="Pe As A" first="Anselmo" last="Pe As">Anselmo Pe As</name><name sortKey="Pe As, Anselmo" sort="Pe As, Anselmo" uniqKey="Pe As A" first="Anselmo" last="Pe As">Anselmo Pe As</name></country><country name="France"><noRegion><name sortKey="Ayache, Christelle" sort="Ayache, Christelle" uniqKey="Ayache C" first="Christelle" last="Ayache">Christelle Ayache</name></noRegion><name sortKey="Ayache, Christelle" sort="Ayache, Christelle" uniqKey="Ayache C" first="Christelle" last="Ayache">Christelle Ayache</name></country><country name="Roumanie"><noRegion><name sortKey="Forascu, Corina" sort="Forascu, Corina" uniqKey="Forascu C" first="Corina" last="Forascu">Corina Forascu</name></noRegion><name sortKey="Forascu, Corina" sort="Forascu, Corina" uniqKey="Forascu C" first="Corina" last="Forascu">Corina Forascu</name></country><country name="Pays-Bas"><noRegion><name sortKey="Jijkoun, Valentin" sort="Jijkoun, Valentin" uniqKey="Jijkoun V" first="Valentin" last="Jijkoun">Valentin Jijkoun</name></noRegion><name sortKey="Jijkoun, Valentin" sort="Jijkoun, Valentin" uniqKey="Jijkoun V" first="Valentin" last="Jijkoun">Valentin Jijkoun</name></country><country name="Bulgarie"><noRegion><name sortKey="Osenova, Petya" sort="Osenova, Petya" uniqKey="Osenova P" first="Petya" last="Osenova">Petya Osenova</name></noRegion></country><country name="Portugal"><noRegion><name sortKey="Rocha, Paulo" sort="Rocha, Paulo" uniqKey="Rocha P" first="Paulo" last="Rocha">Paulo Rocha</name></noRegion></country><country name="Allemagne"><noRegion><name sortKey="Sacaleanu, Bogdan" sort="Sacaleanu, Bogdan" uniqKey="Sacaleanu B" first="Bogdan" last="Sacaleanu">Bogdan Sacaleanu</name></noRegion><name sortKey="Sacaleanu, Bogdan" sort="Sacaleanu, Bogdan" uniqKey="Sacaleanu B" first="Bogdan" last="Sacaleanu">Bogdan Sacaleanu</name></country><country name="Irlande (pays)"><noRegion><name sortKey="Sutcliffe, Richard" sort="Sutcliffe, Richard" uniqKey="Sutcliffe R" first="Richard" last="Sutcliffe">Richard Sutcliffe</name></noRegion><name sortKey="Sutcliffe, Richard" sort="Sutcliffe, Richard" uniqKey="Sutcliffe R" first="Richard" last="Sutcliffe">Richard Sutcliffe</name></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Musique/explor/MozartV1/Data/France/Analysis
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000048 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/France/Analysis/biblio.hfd -nk 000048 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Musique
|area= MozartV1
|flux= France
|étape= Analysis
|type= RBID
|clé= ISTEX:A6C1D4810E440082906320C08345260FB5F100E1
|texte= Overview of the CLEF 2007 Multilingual Question Answering Track
}}
| This area was generated with Dilib version V0.6.20. |  |